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The  research  covered  by  this  report  was  aimed  at  developing  a  broad, 
optimization-based  methodology  for  use  in  computer-aided-design  of  engineering  sys¬ 
tems.  To  this  end,  research  was  carried  out  in  the  following  areas:  (i)  the  development 
of  a  theory  which  can  be  used  as  a  general  guide  in  the  construction  of  semi-infinite 
optimization  algorithms;  (ii)  the  development  of  various  new  semi-infinite  optimization 
algorithms  (superlinearly  converging,  for  use  when  second  derivatives  are  available, 
and  self  scaling,  for  use  in  control  system  design);  (iii)  interior  penalty  type  algo¬ 
rithms  which  offer  a  possibility  of  improved  computational  efficiency;  (iv)  the  develop¬ 
ment  of  techniques  for  formulating  system  stability  and  worst-case  requirements  as 
well-conditioned  semi-infinite  inequalities;  (v)  the  exploration  of  the  use  of  optimiza¬ 
tion  in  the  design  of  control  systems;  and  finally,  (vi)  interactive  software  for 
optimization-based  control  system  design. 

(i)  Algorithm  Theory. 

In  [7],  which  is  a  70  page  paper,  we  have  presented  our  view  of  the  mathematical 
foundations  of  nondifferentiable  optimization  in  engineering  design.  The  theory 
presented  in  [7]  not  only  helps  to  understand  existing  nondifferentiable  optimization 
algorithms,  but  it  also  provides  guidelines  for  the  development  of  new  ones.  In  partic¬ 
ular,  the  theory  in  [7 j  points  out  the  possibility  of  the  construction  of  self  scaling  algo¬ 
rithms.  To  determine  what  effect  this  might  have  on  algorithm  performance,  we 
undertook  a  couple  of  studies  of  rate  of  convergence  which  were  reported  in  [13]  and 


[21].  Since  discretization  cannot  be  avoided  in  the  presence  of  functional  inequalities, 
we  have  recently  begun  to  develop  optimal  discretizations  strategies  to  be  used  in  the 
solution  of  control  system  design  problems  in  which  one  shapes  various  closed-loop 
responses.  We  expect  to  present  our  results  at  the  1988  IEEE  Conference  on  Decision 
and  Control. 

(ii)  Semi-infinite  Optimization  Algorithms  for  Engineering  Design. 

In  [3]  we  have  developed  an  algorithm  for  the  solution  of  optimization  problems 
with  exclusion  constraints,  which  are  combinatoric  in  nature  and  which  arise 
integrated-circuit  macro-cell  placement  problems,  as  a  result  of  nonoverlap  require¬ 
ments.  We  have  developed  a  particularly  efficient  formulation  of  the  problem  of 
placement  of  macro-cells  in  [16]  and  have  carried  out  computational  experiments  to 
test  it. 

In  [5]  we  have  presented  an  exact  penalty  function  algorithm  for  the  solution  of 
optimal  control  problems  with  ordinary  differential  equation  dynamics,  state,  and  con¬ 
trol  constraints.  In  [20]  this  algorithm  was  extended  to  apply  to  problems  with  partial 
differential  equation  dynamics  and  a  number  of  internal  details  were  made  computa¬ 
tionally  more  efficient.  The  resulting  algorithm  was  used  in  computational  experi¬ 
ments  in  the  optimal  slewing  of  flexible  structures,  which  were  described  in  [17]. 

In  [9]  we  have  presented  an  efficient  generalization  of  Newton’s  method  for  the 
minimization  of  the  maximum  of  a  finite  number  of  functions.  At  present  this  work  is 
being  generalized  to  the  case  minimizing  the  maximum  of  a  continuum  of  functions. 
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Search  direction  computations  consume  a  considerable  amount  of  time  in  the 
course  of  semi-infinite  optimization  of  engineering  designs.  In  [23]  we  have  proposed 
a  new,  highly  efficient  method  for  this  purpose. 

When  linear  multivariable  feedback-syste  controllers  are  affinely  parametrized, 
as  is  commonly  done  in  ll°°  design,  the  resulting  optimal  design  problems  are  convex. 
However,  the  affine  parametrization  can  also  introduce  severe  ill-conditioning.  To 
overcome  this  effect,  we  have  been  developing  domain  rescaling  techniques  which 
alleviate  this  problem.  Our  first  results  in  this  area  are  described  in  [21]. 

(iii)  Interior  Penalty  Algorithms  for  Linear  Programming 

Prof.  C.  Gonzaga,  one  of  our  collaborators,  has  explored  the  possibility  of 
improving  Karmarkar’s  linear  programming  algorithm,  in  a  preliminary  stage  to  the 
development  of  interior  penalty  function  algorithms  for  minimax  problems. 

In  [25]  the  linear  programming  problem  is  transcribed  into  a  non-linear  program¬ 
ming  problem  having  as  objective  function  Karmarkar’s  logarithmic  potential  function. 
The  resulting  problem  is  then  solved  by  a  master  algorithm  that  iteratively  rescales  the 
problem  and  calls  an  internal  unconstrained  non-linear  programming  algorithm  that 
reduces  the  potential  function.  It  is  shown  that  Karmarkar’s  algorithm  is  equivalent  to 
this  method  in  the  special  case  in  which  the  internal  algorithm  is  reduced  to  a  single 
line  search.  The  new  algorithm  has  the  same  complexity  as  Karmarkar’s  method,  but 
the  amount  of  computation  is  reduced  by  the  fact  that  only  one  projection  matrix  must 
be  calculated  for  each  call  of  the  internal  algorithm. 


In  [26],  the  linear  programming  problem  is  transcribed  into  a  non-linear  program¬ 
ming  problem  in  which  Karmarkar’s  logarithmic  potential  function  is  minimized  in  the 
positive  cone  generated  by  the  original  feasible  set.  The  resulting  problem  is  then 
solved  by  a  master  algorithm  that  iteratively  rescales  the  problem  and  calls  an  internal 
unconstrained  non-linear  programming  algorithm.  Several  different  procedures  for  the 
internal  algorithm  are  proposed,  giving  priority  either  to  the  reduction  of  the  potential 
function  or  of  the  actual  cost.  Karmarkar’s  algorithm  is  equivalent  to  the  method  in 
this  paper  in  the  special  case  when  the  internal  algorithm  is  reduced  to  a  single 
steepest  descent  iteration.  All  variants  of  the  new  algorithm  have  the  same  complexity 
as  Karmarkar’s  method,  but  the  amount  of  computation  is  reduced  by  the  fact  that  only 
one  projection  matrix  must  be  calculated  for  each  call  of  the  internal  algorithm. 

Reference  [27]  describes  a  short-step  penalty  function  algorithm  that  solves  linear 
programming  problems  in  no  more  than  O(n0SL)  iterations.  The  total  number  of  arith¬ 
metic  operations  is  bounded  by  0(n3L)  ,  carried  on  with  the  same  precision  as  that  in 
Karmarkar’s  algorithm.  Each  iteration  updates  a  penalty  multiplier  and  solves  a 
Newton-Raphson  iteration  on  the  traditional  logarithmic  barrier  function  using  approxi¬ 
mated  Hessian  matrices.  The  resulting  sequence  follows  the  path  of  optimal  solutions 
for  the  penalized  functions  as  in  a  predictor-corrector  homotopy  algorithm. 

(iv)  Stability  Tests  and  Loop-Shaping  Requirement  Specification. 

In  [8]  we  have  presented  a  new  stability  test  for  linear,  time  invariant  multivari¬ 
able  feedback  systems,  in  the  form  of  a  differentiable  semi-infinite  inequality,  and  have 
illustrated  its  use  in  the  design  of  Stabilizing  Compensators  via  semi-infinite  optimiza- 
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tion.  In  [22],  we  presented  a  version  of  this  test  which  can  be  used  in  the  design  of 
finite  dimensional  controllers  for  Infinite  dimensional  feedback-systems  via  semi¬ 
infinite  optimization.  In  [18]  we  presented  a  coherent  approach  to  semi-infinite 
optimization-based  design  of  both  open-loop  and  closed-loop  control  systems  for  flexi¬ 
ble  structures.  In  particular,  we  showed  that  frequency  domain  design  of  closed  loop 
systems,  using  our  stability  test,  produces  finite-dimensional  controllers  without  spill¬ 
over  effects.  In  [11,  12]  and  [14],  we  have  explored  various  aspects  the  design  of 
linear  multivariable  feedback-systems  via  constrained  semi-infinite  optimization  in  ll°° 
Spaces".  These  included  a  study  of  expansions  of  the  controller  in  a  series,  develop¬ 
ment  of  expressions  for  both  time-  and  frequency-domain  loop  shaping,  as  well  as  an 
exploration  of  the  numerical  properties  of  the  ensuing  convex  optimal  design  problem. 

(v)  Novel  Control  Schemes  and  Computational  Procedures. 

In  [6]  we  have  presented  a  novel  adaptive  control  scheme  for  ARMA  plants.  The 
scheme  is  based  on  sequential  plant  uncertainty  identification  and  control  system 
redesign  using  worst  case  design  by  semi-infinite  optimization.  In  [1]  we  have 
presented  a  particularly  efficient  diagonalization  technique  for  the  computation  of  sen¬ 
sitivity  functions  of  linear,  time-invariant  multivariable  systems,  both  open-  and 
closed-loop.  In  [25]  we  have  presented  a  computational  complexity  reduction  tech¬ 
nique  for  use  in  control  system  design  w'hen  the  plant  models  incorporate  both  struc¬ 
tured  and  unstructured  uncertainty.  Experiments  testing  the  effectiveness  of  this  tech¬ 
nique  were  described  in  [2|. 
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(vi)  Software. 


A  version  of  DELIGHT.MIMO:  which  is  an  interactive  system  for  optimization- 
based  multivariable  control  system  design  has  been  completed  and  described  in  [15]. 
Recently  a  user’s  manual  has  been  prepared  for  this  system  as  part  of  an  M.S.  project. 

We  are  currently  implementing  a  second  generation  DELIGHT  system  which  is 
computationally  more  efficient,  and  is  significantly  easier  to  maintain  than  the  existing 
system.  An  important  feature  of  this  system  is  the  X  Window  System  based  user 
interface,  which  significantly  extends  the  rudimentary  interface  of  the  existing  system. 
The  new  system  emphasizes  control  system  design  and  the  interface  allows  the  user  to 
interactively  enter  design  parameters  and  configurations,  and  to  interpret  system  perfor¬ 
mance. 

(vii)  Survey  Papers. 

We  have  written  and  presented  a  number  of  survey  papers  to  assist  the  engineer¬ 
ing  community  in  making  effective  use  of  semi-infinite  optimization  in  design,  see  [4, 
7,  10,  19J. 
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